DOCOMENTRESOHE 



ED 108.-985 



SO 008 328 



AOTHOR 
TITLE 

PUB DATE 
NOTE 



EDRS PRICE 
DESCRIPTOBS 



ABSTRACT 



Breland, Nancy S.; Smith, Marshall P. 
Cognitive and Affective Outcomes of PS 
Programs as Compared to Traditional In 

mp.t A paper prepared for ^ the Annual 
American Educational Research Associat 
Mastery Learning^ Approach and Effects 
D;c., April 1975) 

MF-$0..76 HC-$1.58 PLUS POSTAGE . 
♦Affective Behavior; *Affective Tests; 
Science Research; Cognitive processes; 
An^ilysis; *Conventional Instruction; E 
Research; Higher Education"; .^Programed 
Psychology; *Teaching Method 



I Mastery 
struction. 

Meeting of the 
ion,^ Session on 
(Washington, 



Behavioral 
Comparative 
ducat ional 
Instruction; 



While considerable research has beetKreported on 
cog[nitive outcomes of Personalized Student instruction^ (P^SI), courses, 
little information about affective outcomes of the PSI is^^v^ilable.* 
In this study three methods of instruction including an intrqductpry 
psychology PSI with no formal classes, an educational psychology with 
some formal classes, and a tr aditional-*taught introductory psychology 
with all formal classes were used to investigate affective outcomes. 
Students responded to 12 items designed to sample various levels from 
the Taxonomy of Educational Objectives: Affective Domain. In the last 
iiejQ students ranked all the courses they were taking that semester 
from ^ost favorite to least fayorite. The results indicate np 
significant differences in affeqtive outcomes. Combining scores 
across all items show a very small advantage for the PSI students. It 
is clear that PSI students, who \^re not exposed to a program in a 
formal classroom situation, show 'no affective disadvantage when 
compared to traditionally taught students. (Author/DE) ^ :f 



* Documents acquired by ERl^C include many informal unpublished * 

* materials not available from other sources. ERIC makes every effort 

* to obtain the best copy available, nevertheless, items of mar'ginal 

* reproducibility are often encountered and this affects the quality 

* of the ^microfiche and hardcopy reproductions ERIC makes available 

* via the ERIC Document Reproduction Service (SDES) • EDRS is not 

* responsible for the quality o£ the original document • Reproductions * 

* supplied by EDRS are the best that can be made from the original. * 

3)e 4e 4e >K 3te )!c sle )|e sle sle :i( :^ 9^ 3te 3}( 34e 4e 4t * f ^ * 



U.S. DBPARTMENT OF HEALTH, 
lOUCATiON* WELFARE 
NATIONAL INSTITUTE OF 
EDUCATION 
THIS DOCUMENT HAS BEEN REPRO 
EXACTLY AS REcifvE0"F55« 
THE PERSON OR ORGANrZATION ORIGIN. 

^N^t'dT* . n t/^ / -sf ^ / fJJNG IT. POINTS OF VIEW OR OPINIONS 

J- / JV^ EDUCATION POSrifON OR POLICY. 



Cognitive and Affective Outcomes of PSI (festery Programs 

as Compared to Traditional Instruction J 



I 

Nancy S. Breland nind Marshall P. Smith • 
Trenton State College 



Paper presented at the 1975 AERA Annual Meeting, i'terch 31 ^ April 3, "5375 



\ 



ABSTRACT 

Two types of.PSI programs In Psychology are described. These 2 
courses were compared to. traditional Instruction on 13 items which 
measured affective outcomes of tjie course. On three items, significant 
differences among the 3 groups were found, though these differences were 
:^uite small and inconsistent. When 12 items were summed, a very small 
but significant advantage was found for the 2 PSI groups. It seems 
clear that PSI students, who are not exposed to a professor in a formal 
classroom situation, show no affecti ye =xli sad vantage when compared to 
traditionally taught students. PSI students may even have a slight 
advantage In terms of affective 'outcomes. 
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COGNITIVE AHD AFFECTIVE OUTCOIIES OF PSI/MASTERY PROGRAf'IS 
AS CaiPARED TO TRADITIONAL INSTRUCTION 

Nancy s. Brel and and Marshall P. Smith 
Trenton State College 

Introduction 

In the Fall semester of 1^71, a PSI program was Introduced for 
Introductory Psychology at Trenton State College. The system Is similar 
to that described by Keller (1968). Students enrolled in PSI worked 
through the course at their ovm pace. Each student was required to pass 
a chapter test at 80% or better before he was allowed to go on to the next 
chapter. Student assistants (proctors) were employed to provide immediate 
feedback about test results, and to explain any points missed. All students 
were required to pass 12 chapter tests and a final examination before the 
semester ended. 

Research comparing cognitive outcomes of PSI to traditionally taught 
classes has been conducted for several semesters, and has been reported 
elsewhere (Breland and Smith, 1974). The findings are consistent with those 
of other investigators. (See Kulik, Kulik and Carmichael* 1974, for a 
summary of studies of cognitive outcomes of PSI.) Vte jjave compared PSI 
and traditionally taught students on common final examinations in Introduc- 
tory Psychology I. These tests Included both factual Hctjs and items 
requiring integrative responses, and PSI students have consistently scored 
higher on both types of items. A test of retention of basic concepts from 
Introductory Psychology I administered to students enrolled In Introductory 
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Psychology 11 indicated significantly higher retention by students who 
had studied under the PSI method. A test of retention of more obscure 
concepts administered one semeoter after Introductory Psychology I had 
been taken showed no significant difference between PSI students and 
students taught with traditional methods. 
Affective Outcomes of PSI 

While considerable research he^s been reported on cognitive outcomes . 
of PSI courses, little detailed information about affective outcomes of 
the PSI method, has been reported, Most studies dealing, with affective 
outcomes only ask the students whether they enjoyed the PSI course In 
general, or whether they would choose to take another course in a PSI 
format. Thes6 studies all indicate that PSI courses are popular (Sheppard 
and MacDermot, 1970; f^ers, 1970, McMichael-and Corey, 1972; Lloyd and 
Knutzen, 1959; Born and Herbert, 1971;- Witters and Kent, 1972; Morris and 
ICImbrell, 1972). Some data has been reported comparing the withdrawal rate 
of students from PSI and traditionally taught classes (Bom, Gledhill and 
Davis, 1972; Sheppard and t^c Dermot, 1970) but the results of these studies 
are difficult to interpret. 

Little research is available on the effect of the PSI format on 
attitudes of students toward the subject matter of the course. The lack 
of formal instruction by a professor seems to have no negative effect on 
cognitive outcomes, but will this lack make students less enthusiastic or 
interested in the subject matter?. The issue is complex. Our students 
report that they like the PSI format and clearly they learn more. Doing 
well and liking the method might carry over to more positive attitudes 
towards ttie subject matter. On the other hand, the lack of "interesting" 
films, lectures and demonstrations by an enthusiastic professor might set 

i 
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the PSI system at a disadvantage in terms of student affective outcomes. 
Few studies have been done on this problem. Kullk, Kulik and Carmichael - 
(1974) reviewed a paper by Gallup (1971)' in which it was reported that ■ 
the number of psychology majors had increased since PSI was introduced 
at his institution, a fact which they suggest may Indicate positive 
affect resulting from PSI. Sheppard and MacDermot (1970) asked their 
students, "How does the probable long-range value for you of this course 
compare~Wlth all other courses you have had in college?" but student 
responses to this question were, numerically combined with a general 
evaluation of the PSI format and so were obscured. PSI students reacted 
more favorably on this composite score than did traditionally taught 
students. These investigators also noted that PSI students rated the 
course higher in terms of stimulating more interest and pursuing further 
study in the area. 
^teiWiods 

Three methods of instruction were used to investigate affective X 
.outcomes". The Introductory Psychology PSI format, which uses no films, 
lectures, or formal contact with the instructor, has already been described* 
A modified PSI format is used in Educational Psychology* In this course, 
half of the assigned class periods are set aside for mastery testing 
using procedures similar to those in Introductory Psychology PSL For the 
other half of the class periods, an optional program was made available* 
In this time, films were shovm, lectures and demonstrations were presented, 
and peripheral material was discussed* While no critical material was 
presented, attendance at these enrichment sessions could help students get 
a better grade. No students enrolled in Educational Psychology PSL were 
psychology majors, and for many students the course was their first jcont?ict 



with the discipline of psychology. The course content was comparable in 
many ways to Introductory Psychology, though Educational Psychology PSI 
had a more applied orientation. 

Introductory Psychology. PSI and Educational Psychology PSI v/ere 
compared to traditionally taught Introductory Psychology courses. 
Participation by instructors of traditional Introductory Psychology was 
voluntary, and those instructors with a history of relatively low 
anonymous student evaluations were not asked to participate in this study. 
Instruments 

A short questionnaire concerning affective outcomes was given to all 
PSI students and to those traditionally taught students whose* professors 
agreed to participate. The first 12 items attempted to sample various 
leyels from the Taxonomy of Educational Objectives: Affective Domain 
(Kratwohl, Bloom and Masia, 1954). Students responded to the 12 Items on 
a 5-point scale from strongly agree to strongly disagree. Half of the 
items were stated negatively. The last item asked the students to rank 
all the courses they were taking that semester from most favorite to 
least favorite, and the relative rank of the psychology course was noted. 
Not all students take the same number of courses, so the relative rank of 
the psychology course was not comparable across all students. Since most 
of the students take 5 courses, the relative >ank of the psychology course 
was transformed to an estimated position in a 5-course load. The question- 
naire is presented in Appendix 1. 
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Results 

The three methods of instruction (Introductory Psychology PSI with no 
formal classes, Educational Psychology PSI with some formal classes, 
and traditionally taught Introductory Psychology with all formal classes) 
were compared on each item,on the sum of all 12 items, and on the relative 
rank of the course in^e 5-course load. Table 1 shows the means, standard 
deviations, and sample sizes for each comparison. In 10 of the 13 
individual items, no significant differences among groups was found. In 
only three items were significant differences (p. <.01) found, and these 
diff^erences were quite small. ' 

For item 2 (Even if I had the time, I probabl/ would not take any 
more psychology courses) regular students gave lower (hence more favorable) 
ratings than did Educational Psychology PSi students, though not signif- 
icantly lower than ratings for Introductory Psychology \PSI. This finding 
is difficult to explain. Our PSI students consistently report that the 
PSI classes require more xork than regular classes, and thi^' might explain 
some of the difference. 

Significant differences were also found on Item 6 (The study of 
psychology has been helpful for n\y own personal development). Both PSI 
groups scored significantly higher (more favorably) on this item, though 
again the differences were small. This difference might be explained by the 
fact that students consistently report that the PSI format has improved 

their study habits. The frequent personal attention offered by the proctors 

't 

in PSI might also have influenced the responses to this item. " 

♦ 

Item 10 (No one should be required to learn about psychology) showed 
Educational Psychology PSI students giving lower (more favorable) responses. 



■/ . 

Educational Psychology students are nearly all education majors, and they 
may have found the study of psychology relevant for their career preparation. 
Likewise, Educational Psychology Includes few basic research findings, 
and has a much more applied emphasis. Perhaps the stress on the relevance 
of the material produced this difference* 

To test the general effect of PSI on affective outcomes, of instruction, 
the two PSI groups (Introductory Psychology and Educational Psychology) were 
combined. For all students, a total score was calculated on the first 12 
items. The scoring of negatively stated items was reversed before the 
individual items were summed. The mean^on^th^'-tofal score for the combined 
PSI groups was 45.76 (o = 6.11), while the mean for the students taught by 
traditional methods 44.76 ( a = 5.99). The advantage of the^PSI groups was 
quite small, but significant at the .05 level. / 

No psychology majors were enrolled in Educational Psychology PSI, and 
40 of the students taking Introductory Psychology stated that they were 
psychology majors. The psychology majors might have biased the results. 
All comparisons were therefore recalculated, omitting psychology majors. 
These omissions had a negligible effect on the results; the same significant 
differences were observed. 



/ 



7 



Conclusions i 

The superiority of our PSI program in bringing about higher student • 
achievement and retention In Introductory Psychology seems clear. The 
Introductory Psychology PSI program has no formal instruction associated 
with it. A PSI. program in Educational Psychology, which serves a different 
studerrTpopulation but which handles similar material , provides a series of 
optional classes. These two methods of Instruction were compared to 
trad1t1onal_instruct1on in Introductory Psychology on 13 items measuring 
affective outcomes. G^eraVlyrno differences in affective outcomes were 
noted^,. On those 3 items on which significant differences appeared. 



differences among the groups were small. Two of the items favored PSI 
groups, and on one item, the Educational Psychology PSI program was ranked 
least favorably. Combining scores across all 12 questionnaire items < 
(negatively stated items were reversed) showed a very small advantage for 
-the PSI students. • ^ 

Although the questionnaire in ceneral shows a very slight advantage 
for PSI students on affective outcomes, it is difficult to make a strong 
conclusion about their superiority. It ^eems clear, however, that PSI 
students are not any less positively oriented towards the discipline of 
psychology than are their traditionally taught peers. 
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TABLE I 



Comparison of 3 Types of Instruction 
On Items Measuring Affectfve Outcomes ^ 



PSI Intro. 2.36 1.01 269 

p<.OT • PSI Ed. 2.07 .94 140 

I 



I 



Item ■ Kean g iL_ 

Iteml. Regular 4.10 > .85 145 

NS ! PSI Intro 4.19 ) .78 . 273 

PSI Ed. ' 4.06 ^- 1.00 - 14j'- 

Item2* Regular 1.75 .88 147 

PSI Intro 1.89 .92 273 

p<.01 / PSI Ed. ^ ^ 2.15 1.16 142 

Item 3 ' Regular 2.35 1 03 147' 

Nr PSI Int'o 2.30 .94 272 

PSI Ed. 2.29 .98 142 

Item 4 ^ Regular ' 3.32 .97 • 146 

NS , P^I Intro 3.29 .84 272 

•« PSI, Ed. 3.22- .91 140 

Items Regular / 1.94 .99 146 

NS * PSI. Intro 1.75 .78 272 

PSI Ea. 1.87 .97 141 

Item 6 . Regular 3.73 .89 147 

PSI Intro-. 4.01 .78 274 

p<.01 * PSI Ed 4.06 .87 139 

Item 7 Regular " 3.95 .78 144' 

HS ! PSI Intro. 3,96 .74 273 

PSI Ed. 3.85 .90 141 

Item. 8* Regular 2.77 ,91 146 

HS V PSI Intro. 2.62 • ,,89 271 

\ PSI Ed. 2.55 ^ 792 140 

Item 9 ^ Regular \ 3.40 ^ .98 145 

NS PSI Intro - \3.54 .97 • 269 

PSI Ed i3.32 1.14 140 

Item 10 Regular 2.59 1.01 145 




Comparison of 3 Types of Instruction 
On Items Haasuring Affective Outcomes 



Ite r' 

Item, .11 
NS * ■ 



Item 12 
NS 



' 1 Rank of 
Psychology 
Course ~ 

, «s - ■ , 

Sum. Items 1-12 
p<.05. 



Regular 
PSI Intro. 
PSI Ed. 

Regular 
PSI Intro* 
PSI Ed. '■' 

Regular 
PSI Intro. 
PSI Ed. 



Regular 
PSI Intro 
PSI Ed. 



Mean 


a 




1.79 


.83 


145 


1.73 




266 


1.73 


.75 


140 • 


3.48 


.81 


146 


3.62 


.81 


268 


3.51 


.87 


137 


2.41 


1.14 


142 


2.41 


1.02 


245 


2.37 


- 1.07 


132 



44.76 
46.15 
45.60 



5.99 
5.97 
6.37 



138 
255 
131 



* Starred Items are stated negatively, hence <a lower mean score Is the more 
favorable one. 
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Appendix I 

/ ^""^v AFFECTIVE OUTCOiiES QUESTIONI^IAIRE 

Psychol'ocjy course vifilcH yo|j are presently enrolled " 

Is this \ PSI or a regular course?" PSI Regular 

Your .major Your class: Fr. Soph. Jr. Sr. 

Please Indicate how you feel about the following questions by rating them this way: 

SA » Strongly Agree, A^« Agree, ? = Neutral, D -disagree, SD = Strongly / 

' Dliagree 



1. I enjoy s,tudying psychology SA A ? D SD^ 

2. Even if/I had the tiaie, I probably would not take any 

more ^.sychology courses ...^ SA A ? D SD 

3. I seldom discuss psychology with my friends SA A ? D SD 

4. r encourage iny friends to study psychology SA A ? D SD 

5. Psychology is a boring subject SA A ? D SD 

6. The study of psychology has been helpful for iny own personal 
Uavelopment >, SA A ? D SD 

7. If I saw an article in the newspaper about psychology, I 

i.ould probably read it .i. ; SA A ? D SD 

8. I would probably not gp to a free lecture about psychology SA A ? D SD 

9. I would probably voTunteer (without money or credit^ to 

be a subject. in Ja psychological study ' SA A ? D SD 

10. . No one shoulil be required^ to learn about psychology SA A 7 D SD 

11. Psychology plays a relatively unimportant role in every 

day life SA A ? D SD 

12. If more people knew about, psychology,] the world would be a- 

better place to live .% \ SA A ? D SD 



1 \ 



13. Please rank all the courses you are studying this semester 
from your most favorite to your least favorite 

1. 

2. ' 

y 3. 



